Voltage Coordination of FACTS Devices in Power Systems Using RL-Based Multi-Agent Systems

i Corresponding Author, M. R. Tousi is PhD student in Department of Electrical Engineering, Amirkabir University of Technology, Tehran, Iran (e-mail: [email protected]). ii S. H. Hosseininan is with the Department of Electrical Engineering, Amirkabir University of Technology, Tehran, Iran (e-mail: [email protected]). iii M. B. Menhaj is with the Department of Electrical Engineering, Amirkabir University of Technology, Tehran, Iran (e-mail: [email protected]). ABSTRACT This paper describes how multi-agent system technology can be used as the underpinning platform for voltage control in power systems. In this study, some FACTS (flexible AC transmission systems) devices are properly designed to coordinate their decisions and actions in order to provide a coordinated secondary voltage control mechanism based on multi-agent theory. Each device here is modeled as an agent being able to cooperate and communicate with other devices. In this system, individual autonomous agents and intelligent decision makers learn to perform optimal actions through proper interactions with their environments. The SARSA Q-learning, which is an on-policy algorithm in reinforcement learning (RL) is then used and tested successfully in voltage control problem. In this research, the Java Agent DEvelopment (JADE) platform is used to implement the agents and to simulate their communications. The power system is also fully implemented in Java. The proposed intelligent MA based method is finally applied to IEEE 39buses New England power system. The results of simulation better highlight the merit of the method and its ability in coordinating FACTS devices for removing voltage disturbances.